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(54) Disk array controller and method for adapting the numt)er of control units in a disk array 
controller 



(57) A disk array controller is made up of multiple 
disk array control units (1-1 , 1-2, 1-3) for Implementing 
the data readtmiXe operation and each having channel 
IF units (1 1 ), disk IF units (1 2), cache memory units (14) 
and shared memory units (1 3). The disk array controller 
further Includes interconnections (24, 25, 210, 220) for 



interconnecting the shared memory units (13) and inter- 
connecting the cache memory units (14) across the bor- 
der of disk array control units. Theret>y alleviating the 
deterioration of perf omnance due to the data transfer be- 
tween the disk anny control units, when the multiple disk 
array control units are to be operated as a single disk 
array controller. 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present Invention relates to a controller of 
a disk array apparatus which stores data on muttfple 
hard disk drives. 

[0002] As compared with the computer main storage 
whbh is based on the semiconductor memory, the disk 
subsystem (wiD be temned simply "sutisystem") which is 
based on the magnetic disk mmory is sluggish in re- 
gard to the I/O pert omwice by a degree of the order of 
3-4 digits, and continuous efforts have been paid to re- 
duce the difference of these memories, i.e., improve the 
I/O performance of the suk)system. 
[0003] A known scheme to improve the I/O perform- 
ance of the subsystem Is the adoption of a disk array 
system In whk:h multiple hard disk drives are organized 
to fomn a subsystem, and data is stored on the multiple 
hard disk drives. 

[0004] For example, a prior art system shown In Fig. 
2 includes multiple channel IF units 11 which innplement 
the data transfer between host computers 50 and disk 
array controllers 2, multiple disk IF units 12 which im- 
plement the data transfer between magnetic disk drives 
5 and disk array controllers 2. cache memory units 14 
which temporarily store data of the hard disk drives 5, 
and shared memory units 13 which store control infor- 
mation for the disk array controllers 2 (e.g., information 
on data transfer control between the channel IF units 1 1 
and disk IF units 1 2 and the cache memory units 1 4 and 
control information for data stored in the hard disk drives 
5). In each disk anny controller 2, the shared memory 
unit 1 3 and cache memory unit 1 4 can be accessed by 
all channel IF units 11 and disk IF units 12. 
[0005] In the disk array controller 2, the channel IF 
units 11 and disk IF units 12 are connected to the shared 
memory unit 1 3 by an interconnection 21 , and the chan- 
nel IF units 11 and disk IF units 12 are connected to the 
cache memory unit 14 by another interconnection 22. 
[0006] The channel IF unit 1 1 has the Interface for the 
connection to host computers 50 and a microprocessor 
(not shown) whbh controls the data transaction with the 
host computers 50. The disk IF unit 1 2 has the interface 
for the connection to hard disk drives 5 and a microproc- 
essor (not shown) whbh controls the data transaction 
with the hard disk drives 5. The disk IF units 12 have the 
RAID function. 

[0007] This conventional disk array controller 2 has 
an upper limit of disk storage capacity which can be con- 
nected to it, and therefore for storing data In excess of 
the volume of data manageable by one disk array con- 
troller 2, multiple disk array controllers 2 are Installed 
and channels from the host computers 50 are connected 
to the disk array controllers 2. Furthermore, for connect- 
ing host computers 50 in excess of the number of host 
channels whk:h can be connected to one disk array con- 
troller 2, multiple disk array controHers 2 are Installed 



and connected to the host computers 50 indivkiually. 
[0008] For data transfer between two disk array con- 
trollers 2, channels from the host computers 50 are con- 
nected to the two disk array controllers 2 and data is 

5 transferred via the host computers 50. 

[0009] Another prior art system shown in Fig. 3, whbh 
is disclosed in U.S.Patent No.5,680,640, is designed for 
example to transfer data between two disk array con- 
trollers 3 based on the connection of part (two lines in 

10 Rg. 3) of the <x>mputer interface paths of the disk anBy 
controllers 3 and the data transfer from a hard disk drive 
5 whbh is connected to one disk array controller 3 to 
another hard disk drive 5 which is connected to another 
disk array controller 3 through the data transfer path 8. 

15 [0010] Another prior art system shown In Fig. 4 is de- 
signed for example to store data In excess of the volume 
of data manageable by one disk array controller, con- 
nect host computers in excess of the number of host 
channels which can be connected to one disk array con- 

20 troller, or transfer data among multiple disk array con- 
trollers, as shown in Fig. 4, based on the Installation of 
multiple disk array cx>ntronerB 4 and the connection of 
their computer interface paths to the host cxjmputers 50 
via a switch-based interconnection 23. 

25 [0011] A disk array processing device disclosed in 
Japanese Unexamined Patent Publication No.Hei- 
1 1 -66693 Includes two director units whteh use a shared 
m^ory to recover data when a data spindle whkti 
forms a disk array runs out of control. This patent pub- 

30 ik:ation, however, does not show the installation of mul- 
tiple disk arrays. 

[0012] In large business enterprises whfch typically 
include banks, stock traders, and telephone companies, 
there are trends of cutting the expenditure for the oper- 

35 ation, maintenance and management of computer sys- 
tems and storage systems based on the centralized in- 
stallation of computers and storages which have been 
installed distributively in many places. In this movement 
with the times, large high-end disk array controllers are 

^ required to bear the channel interface for the connection 
to several-hundreds or more host computers and huge 
storage capacities of several-hundreds terabytes or 
more. 

[0013] At the same time, due to growing open markets 
<s in recentyears and storage area networics (SANs) whk^h 
are expected to prevail in coming years, there are rising 
demands of snrmll-scale (compact) disk array controllers 
which are comparable in performance and reliability with 
large high-end disk array controllers. 
50 [0014] The fonner requirement will conceh^ably be 
met by connecting multiple conventional large high-end 
(fisk array controllers to build a huge disk array cx>ntrol- 
ier. The latter requirement will conc^eivably be met by 
arranging a k>west-tevel model (e.g., with small num- 
55 bers of c^hannel IF units and disk IF units) of a c^onven- 
tional large high-end disk anray controller. An additional 
conceivable scheme Is to connect a plurality of this com- 
pact disk array controller thereby to buiki a controller 
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which supports systems of medium to laiige scales 
which have been supported by a conventional disk array 
controller 

[001 5] Accordingly, It becomes necessary for disk ar- 
ray controllers to have the scalability so as to be con- 
structed to cover the range from a small to huge-scale 
controllers based on the same basic architect re of high 
performance and high reliability, and therefore there 
arises a demand of a disk array controller, a plurality of 
whk:h are integrated to operate as a single disk array 
controller. 

[001 6] However, although the prior art system shown 
In Rg. 2 can have an increased numt>er of channels and 
increased storage capability for the host computers 50 
by simply increasing the number of disk array controllers 
2, the host computers 50 need to connect channels to 
ail disk anBy controllers 2 so that one host computer 50 
can transact data with multiple disk array controllers 2. 
Moreover, It is necessary for one host computer 50 
whbh is going to make access to data to kientify a disk 
array controller 2 that is connected to the hard disk drive 
5 which stores the data. On this account, it is drffk»jlt to 
operate multiple disk array controllers as a single disk 
array controller. 

[0017] The prior art system shown in F^. 3 has disk 
array controllers 3 interconnected by the data transfer 
path 8, enabling onehostcomputerSO which is connect- 
ed to a certain disk array controller 3 to make access to 
data on a hard disk drive 5 which Is connected to other 
disk array controller 3, and accordingly it is possible to 
operate multiple disk array controllers 3 as a single disk 
array controller. 

[0018] However, in case a host computer 50 issues a 
data read request to a disk array controller 3 and the 
data is absent on the hard disk drives 5 connected to 
the controller 3, it is necessary for the disk an^y con- 
troller 3 to send the read request to other disk array con- 
troller 3 over the data transfer path 8, receive the re- 
quested data over the data transfer path 8 from the disk 
array controller 3 which Is connected to the hard disk 
drive 5 on which the data is stored, and send the re- 
quested data to the host computer 50. On this account, 
this system suffers a degraded performance when a 
host computer 50 makes access to data whbh is stored 
on a hard disk drive 5 connected to a disk array control- 
ler 3 other than the disk array controller 3 connected to 
itself. 

[0019] For coping with this matter, if a host computer 
50 transfers in advance data of frequent access, which 
is stored on a hard disk drive of a disk array controller 
other than that connected to itself, to the hard disk drive 
5 of the disk array controller connected to itself, the sys- 
tem also suffers a degraded perfonnance due to the da- 
ta transfer over the data transfer path 8. 
[0020] In the prior art system shown in Rg. 4, each 
host computer 50 can access to all disk array controllers 
4 via the switch-based interconnection 23. However, in 
order to operate multiple disk array controllers 4 as a 



single disk array controller, each switch of the intercon- 
nection 23 must have a map indicating as to whnh of all 
disk array controllers 4 connected to the switch stores 
data, and must have a function of analyzing the access 

5 request from a host computer 50 and designating a disk 
array controller 4 which stores the requested data. 
[0021] Due to the need of request command analysis 
by the switches besides the command analysis by the 
conventional channel IF units 11, this system suffers a 

10 degraded performance In contrast to the direct connec- 
tion of the host computers 50to the disk array controllers 
4. 

[0022] The high-end disk array controllers have fol- 
lowing functions. 

15 [0023] As a specific operational functton, a data set 
(corresponding to a k>gk»l volume) for one work is du- 
plicated and stored and both the original and duplicate 
data sets aro updated simultaneously In the ordinary 
work. At the emergence of the need of backup for the 

20 data set for example, updating of the duplk»te data set 
is suspended and it is used for the backup, while the 
original data set is used continuously for the work, and 
the original and duplk:ate data sets are rendered the 
matching process on completion of backup. 

25 [0024] For accomplishing this operational function, 
with duplicate data sets being held in different disk a^ay 
controllers, the prior art systems shown In Rg. 2 to Fig. 
4 all need to transfer data sets among the disk an-ay 
controllers, resulting in a significantly deteriorated sys- 

30 tern performance. 

SUMIWARY OF THE INVENTION 

[0O25] An object of the present invention is to provide 

35 a disk anBy controller having the scalability so as to be 
constructed to cover the rEmge from a small to huge- 
scale controllers based on the same baste architecture 
of high performance and high reliability. 
[0026] More specifically, the present invention Is in- 

40 tended to provide a disk array system which is capable 
of alleviating the deterioration of perfomrmnce caused 
by the data trEuisfer anru>ng multiple disk array control- 
lers which aro designed to operated as a single disk ar- 
ray controller, and accomplish the function of a disk ar- 

^ ray controller based on a plurality of disk array control- 
lers while alleviating the deterioration of periormance. 
[0027] In order to achieve the above objectives, the 
present invention resides in a disk array controller which 
includes a plurality of disk an^y control units, each hav- 

so ing one or more channel interface units for interfacing 
with a computer, one or more disk interface units for in- 
terfacing with disk drives, a cache memory unit which is 
connected to the channel Interface unit and disk inter- 
face unit and adapted to store temporarily data which is 

S5 written to or read out of the disk drives, and a shared 
memory unit which is connected to the channel interface 
unit and disk interface unit and adapted to store control 
information of data transfer between the channel inter- 
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face unit and disk interface unit and the cache nnemory 
unit and control information for the disk drives, and hav- 
ing a disk control fundion for inr)plementing the data 
read^vrtte operation in response to a data read/Write re- 
quest from the host computer by operating on the chan- 
nel interface unit to transfer data between the interface 
with the host computer and the cache memory unit and 
operating on the disk interface unit to transfer data be- 
tween the disk drh^e and the cache memory unit, and 
further includes means of Interconnecting the shared 
memory units in the disk array control units and means 
of interx:onnecting the cache memory units in the disk 
array control units, thereby enabling the data readAwrite 
access from a channel interface unit or disk interface 
unit In one disk array control unit to a shared memory 
unltorcachememory unit In other disk array control unit. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0028] 

Fig. 1 is a block diagram showing the arrangement 
of a disk array controller based on this invention; 
Fig. 2 is a block diagram showing the arrangement 
of a conventional disk array controller; 
Fig. 3 is a block diagram showing the arrangement 
of another conventional disk array controller; 
Fig. 4 is a block diagram showing the arrangement 
of still another conventional disk array controller; 
Fig. 5 is a block diagram showing the arrangement 
of another disk array controller based on this Inven- 
tion; 

Fig. 6 is a block diagram showing the arrangement 
of still another disk array controller based on this 
Invention; 

Fig. 7 is a block diagram showing the detailed ar- 
rangement of the disk array control unit shown In 
Fig.1; 

Fig. 8 is a block diagram showing the arrangement 
of a disk anBy controller made up of two disk array 
control units shown In Fig. 7 connected together; 
Fig. 9 Is a block diagram showing the detailed ar- 
rangement of the disk array control unit shown In 
Fig. 5; 

Fig. 1 0 is a block diagram showing the arrangement 
of a disk array controller made up of two disk array 
control units shown In Fig. 9 connected together; 
Fig. 11 is a block diagram showing the detailed ar- 
rangement of \he disk anBy control unit shown in 
Fig. 6; 

Fig. 1 2 Is a block diagram showing the arrangement 
a disk array controller made up of two disk array 
control units shown in Fig. 11 connected together; 
Fig. 1 3 is a block diagram showing the arrangement 
of a disk array controller made up of three disk array 
control units shown in Fig. 7 connected together; 
Fig. 14 Is a perspective view showing the structure 
of a disk array control unit built on a rack based on 



this invention; 

Rg. 15 is a perspective view showing the structure 
of a disk array controller made up of two disk array 
control units which are buitt on racks and interoon- 
5 nected; 

Rg. 1 8 is a perspective view showing the structure 
of a disk array control unit built on a different rack 
based on this invention; 

Rg. 1 7 is a perspective view showing the structure 
10 of a disk array controller made up of four disk array 
control units whtoh are built on one rack based on 
this invention; 

Rg. 18 is a block diagram showing the wiring 
scheme for three disk array control units based on 

15 tnter-rack switches; 

Rg. 1 9 is a perspective view of the structure of the 
wiring shown in Rg. 18 based on this invention; 
Rg. 20 is a block diagram showing the connection 
of three disk array control units based on this Inven- 

20 tion; 

Rg. 21 is a diagram showing an example of the data 
fomnat of Information of path switching which is giv- 
en to the switch box; and 

Fig. 22 is a table showing an example of the refer- 
25 ence table of information of path switching provided 
In the switch t>ox. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

30 

[0029] In the following embodiments of this invention, 
hard disk drives are adopted for a large-capacity data 
storage. However, it is not confined in this Invention to 
hard disk drives, but it can be DVDs for example. 

35 [0030] As a preferred embodiment of this invention, 
the channel Interface units and disk interface units and 
the cache memory units in the multiple disk array control 
units are Interconnected by a switch-based interconnec- 
tion whbh extends across the border of disk array con- 

40 ti^i units, and the channel interface units and disk inter- 
face units and the shared memory units are intercon- 
nected by another switch-based interconnection which 
extends across the border of disk array control units. 
[0031] As another preferred embodiment, the channel 

^ interface units and disk Interface units and the cache 
memory units in the multiple disk array control units are 
Interconnected by a swltch-t»sed interconnection 
which extends across the border of disk array control 
units, and the channel interface units and disk interface 

50 units and the shared memory units are connects di- 
rectly for tile portion within each disk array control unit 
and Interconnected for the portion between the shared 
memory units between the disk array control units by a 
switch-based interconnection whk:h extends across the 

55 border of disk array control units. 

[0032] As another pref en^d embodiment, the channel 
Interface units and disk interface units and the cache 
memory units In the multiple disk array contml units are 
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connected directly for the portion within each disk array 
controi unit and interconnected for the portion between 
the cache nrtennory units between the disk array control 
units by a switch-based interconnection which extends 
across the border of disl( array control units, and the s 
channel interface units and disk interface units and the 
shared mennory units are connected directly for the por- 
tion within each disk array control unit and interconnect- 
ed for the portion between shared memory units be- 
tween the disk array control units by a switch-based in- 
terconnection which extends across the border of disk 
array control units. 

[0033] With respect to the data read/wrtte operation 
between host computers and the hard disk drives, the 
Inventive disk array controller Includes a plurality of disk 
array control units, each having channel interface units 
for interfacing with the computers, disk interface units 
for interfacing with the hard disk drives, a cache memory 
unit for storing temporarily data which is written to or 
read out of the hard disk drives, a shared memory unit 
for storing control Information of data transfer between 
the channel Interface units and disk interfece units and 
the cache memory unit and control infonnation for the 
hard disk drives, means of connecting the channel in- 
terface units and disk interface units to the cache mem- 
ory unit, and means of connecting the chcmnei Interface 
units and disk interface units to the shared memory unit, 
and implementing data read/write in response to a data 
read/write request from the host computer by operating 
on the channel interface units to transfer data between 
the interface with the host computer and the cache 
memory unit and operating on the disk interface units to 
transfer data between the hard disk drive and the cache 
memory unit, and further includes means of intercon- 
necting the shared memory units in the disk anay control 
units and means of Interconnecting the cache memory 
units In the disk array control units, thereby enabling the 
data read/write access from a host computer which is 
connected only to one disk an^y controi unit to a hard 
disk drive which is connected only to other disk array 
control unit by way of the interconnection means. 
[0034] Other problems and schemes of sohring the 
problems based on the present invention will become 
apparent from the following descriptk>n of ennbodiments 
taken in conjunction with the accompanying drawings. 
[0035] Embodiments of the present invention will be 
explained witii respect to the drawings. 

[Embodiment 1] 

[0036] Fig. 1 , Fig. 7 and Fig. 8 show an embodiment 
of this invention. Although devces of interoonnection 
used in this embodiment are based on switches, these 
devices which function to transfer control information 
and data between two units may othemrlse be buses for 
example. 

[0O37] A disk array controller 1 of this embodiment is 
made up of multiple disk array control units 1 -1 as shown 
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in Rg. 1 . Each disk array control unit 1-1 Includes Inter- 
face units (channel IF units) 11 for Interfacing with host 
computers 50, interface units (disk IF units) 12 for inter- 
fadng with hard disk drives 5, shared memory units 13, 
and cache memory units 14. The channel IF units 11 
and disk IF units 12 and the shared memory units 13 
are connected by an interconnection 210 which is 
shared by the disk array control units 1 -1 , and the chan- 
nel IF units 11 and disk IF units 12 and the cache mem- 
ory units 14 are connected by another lntercx)nnection 
220 whk^ is shared by the disk array control units 1 -1 . 
Accordingly, all channel IF units 11 and disk IF units 12 
can access to all shared memory units 13 or all cache 
memory units 14 via the interconnection 210 or 220. 
[0038] One disk array control unit, which may be el- 
ttier built on a rack or built as a module, can operate as 
a stand-alone disk array controller. Each disk array con- 
trol unit is assumed to be built on an individual rack in 
the explanation of Fig. 7. 

[0O39] F^. 7 shows a spedf to internal arrangement of 
tiie disk array control unit 1-1 . 
[0040] The disk array control unit 1-1 includes two 
channel IF units 11 for interfacing witii host computers 
50, two disk I F units 12 for interfacing with the hard disk 
drives 5, two shared memory path switches (SM-SWs) 
110, two cache memory path switches (CM-SWs) 111 , 
two shared memory units 13, two cache memory units 
14, shared memory (SM) access paths 135 and 136. 
cache memory (CM) access paths 137 and 138. inter- 
unit SM patiis 141. and inter-unit CM paths 142. The 
inter-unit SM paths and inter-unit CM paths connect be- 
tween the disk anay control units. 
[0041] The channel IF unit 11 includes two host IFs 
102 for interfacing with the host computers 50, two mi- 
croprocessors 101 whtoh control the data transaction 
with the host computers 50, an SM access controller 1 04 
which controls the access to the shared memory units 
13, and a CM access controller 105 whbh controls the 
access to the cache memory units 14. It implements the 
data transfer between the host computers 50 and the 
cache memory units 1 4 and the transfer of control infor- 
mation between the microprocessors 101 and the 
shared memory units 13. The microprocessors 101 and 
host IFs 1 02 are connected by an internal bus 1 06. The 
CM access controller 105 is connected directfy to the 
two host Ifs 102. The SM access controller 104 is con- 
nected directiy to the two microprocessors 1 01 . 
[0042] The disk IF unit 12 includes two drive IFs 103 
for Interfacing with hard disk drives 5, two microproces- 
sors 1 01 whfeh control the data transaction with the hard 
disk drives 5, an SM access controller 104 whtoh con- 
trols the access to the shared memory units 13, and a 
CM access controller 105 whteh controls the access to 
the cache memory units 14. It implements the data 
transfer between the hard disk drives 5 and the cache 
memory units 14 and the transfer of control infonnation 
between the microprocessors 1 01 and the shared mem- 
ory units 1 3. The microprocessors 1 01 and drive IFs 1 03 
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are connected by an internal bus 106. the CM access 
controller 1 05 is connected directly to the drive IPs 1 03, 
and the SM access controller 1 04 is connected directly 
to the microprocessors 101 . The disk IF unit 12 also ini- 
plement the RAID function. 

[0043] The shared memory unit 1 3 includes a shared 
memory (SM) controller 1 07 and a memory module 1 09, 
and it stores control information of the disk array control 
unit 1 -1 (e.g., information on data transfer control be- 
tvreen the channel IF units 11 and disk IF units 12 and 
the cache memory units 14, and control Infomnation for 
data recorded on the hard disk drives 5). 
[0044] The cache memory unit 1 4 includes a cache 
memory (CM) controller 1 08 and a menwry module 1 09, 
and R temporarily stores data to be recorded on the hard 
disk drives 5. 

[0045] The SM access controller 1 04 is connected to 
the two SM-SWs 110 which is different from each other 
by two SM access paths 1 35, and the SM-SWs 1 1 0 are 
connected to the two SM controllers 1 07 which Is differ- 
ent from each other by two access paths 136. Accord- 
ingly, each SM controller 107 has the connectton of two 
access paths 136 coming from the two SM-SWs 110, 
enabling each SM controller 104 to have two access 
routes to each SM controller 107. in consequence, In 
the event of a fault on one access path or in one SM- 
SW 110, the shared memory units 1 3 are kept accessi- 
ble through another route. 

[0046] The CM access controller 1 05 is connected to 
the two CM-SWs 111 by two CM access paths 137, and 
the CM-SWs 111 are connected to the two CM control- 
iers 1 08 by two access paths 1 38. Accordingly, each CM 
controller 1 08 has the connection of two access paths 
138 coming from the two CM-SWs 111, enabling each 
CM controller 105 to have two access routes to each 
CM controller 108. In consequence, In the event of a 
fault on one access path or In one CM-SW 111, the 
cache memory units 14 are kept accessible through an- 
other route. 

[0047] The SM-SW 1 1 0 has the connection of four SM 
access paths 135 coming from the two channel IF units 
1 1 and two disk IF units 1 2, and also has the connection 
of two access paths 1 36 going to the two shared mem- 
ory units 13. The SM-SW 110 also has the connection 
of two inter-unit SM paths 141 for the connection with 
SM-SWs 1 1 0 of other disk array control unit 1 -1 . These 
inter-unit SM paths 141 may be designed differently for 
input and output, or may be designed equally for the bi- 
directional information transfer. 
[0048] The CM-SW 1 1 1 has the connection of four CM 
access paths 137 coming from the two channel IF units 
1 1 and two disk I F units 1 2, and also has the connection 
of two access paths 1 38 going to the two cache memory 
units 14. The CM-SW 111 also has the connection of 
two inter-unit CM paths 142 for the connection with CM- 
SWs 1 1 1 of other disk anray control unit 1 -1 . These inter- 
unit CM paths 142 have the same design as the inter- 
unitSM paths 141. 



[0049] Based on the above-mentioned access path 
connection of the SM-SWs 1 1 0 and CM-SWs 111, these 
SWs 110 and 111 have a f uneven of directing access 
requests from the channel IF units 11 and disk IF units 

5 12 over the four access paths to the two access paths 
of the shared memory units 13 or cache memory units 
14 within the self disk array control unit 1 -1 and the two 
inter-unit access paths of the shared memory units 13 
or cache memory units 1 4 of other disk array control unit 

10 1-1. 

[0050] In the arrangennent of Fig. 7, the SM-SW^ 1 1 0 
are connectton nodes between the channel IF units 11 
and disk IF units 12 and the shared memory units 13, 
and the CM-SWs 11 1 are connectk>n nodes between the 
IS channel IF units 11 and disk IF units 12 and the cache 
memory units 14. 

[0051] Rg. 8 shows an example of the disk array con- 
troller 1 which is configured by connecting two disk array 
control units 1 -1 shown in Rg. 7. The two disk array con- 

20 troi units 1 -1 -1 and 1 -1 -2 have their SM-SWs 1 1 0 Inter- 
connected by Inter-unit SM paths 141 via inter-unit SM- 
SWs 121 . Similariy. the CM-SWs 111 of the disk anray 
control units 1 -1 -1 and 1 -1 -2 are Interconnected by inter- 
unit CM paths 1 42 via inter-unit CM-SWs 1 22. The SWs 

25 121 and 122 are mounted as switch boxes. 

[0052] In case, as In this emt)odiment, the disk array 
controller Is made up of two disk array control units 1 -1 , 
these units can be connected directly through the inter- 
unit paths Instead of using the inter-unit SWs 121 and 

30 without imposing any problem on this invention, 
while eliminating the overhead process of data transfer 
in the inter-unit SWs 121 and 122. 
[0053] The disk array controller 1 shown in Rg. 8 will 
be able to include three or more disk an-ay control units 

35 1.1 by designing the inter-unit SWs 121 and 122 to have 
an increased number of path connection. The number 
of the path, which can be mounted to the inter-unlt SWs 
121 and 122. is physically limited. For connecting disk 
array control units 1 -1 in excess of the limit In the number 

40 of path connection of the Inter-unit SWs 121 and 122, 
they cannot be connected by one Inter-unit SW. In the 
case, the Inter-units SWs are used In multiple stages to 
increase the number of the disk array controller connect- 
ed. 

^ [0054] Rg. 1 9 shov^ an example of a disk an^y con- 
troller whbh is made up of three disk array control units 
built on individual racks and interconnected through a 
switch box, as will be explained in detail later. 
[0055] For connecting three or more disk array control 

so units 1-1,theSM-SWs 110 and CM-SWs 111 in all units 
1-1 are each connected In a loop fashion as shown in 
Rg. 13. This Interconnecting scheme enables the loop 
connection of multiple disk array control units 1-1 with- 
out using the inter-unit SWs 121 and 122. Specif icalty, 

S5 the inter-unit SM paths of adjacent units 1 -1 and the in- 
ter-unit CM paths of adjacent units 1-1 are each con- 
nected by connectors. Preferably, these connectors of 
the inter-unlt SM paths 141 and Inter-unit CM paths are 
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fixed on the exterior wall of the disk array control units 
1-1 for the convenience of the additional installation of 
units 1-1 , although it is not shown in the figure. 
[0056] In the anrangenwnt of Fig. 8, the SM-SWs 1 1 0, 
inter-unft SM paths 141 and inter-unit SM-SWs 121 in 
unison constitute the interconnection 210 shown in Rg. 
1, and the CM-SVils 111, inter-unit CM paths 142 and 
inter-unit CM-SWs 122 in unison constitute the intercon- 
nec^on 220. 

[0057] An example of the operation of the arrange- 
ment shown in Fig. 8 for reading out data from a host 
computer 50 which is connected to the disk array control 
unit 1-1-1 will be explained. 

[0058] Initially, the host computer 50 issues a data 
read-out request to the channel IF unit 11 In the disk 
array control unit 1 -1 -1 to whkA It is connected. The mi- 
croprocessors 101 In the channel IF unit 11 whk:h has 
received the request makes access to both shared 
memory units 13 In both disk array control units 1-1-1 
and 1-1-2 thereby to find as to which hard disk drive 5 
stores the requested data. The search is executed 
based on the conversion table stored in the shared 
memory units 1 3 indicative of the con-espondence of the 
address of the requested data and hard disk drives 
which stores the data. 

[0059] Subsequently, the microprocessors 101 In the 
channel IF unit 11 whteh has recehred the request 
makes access to both shared memory units 13 in both 
disk array control units 1-1-1 and 1-1-2 thereby to find 
as to whether or not the requested data is present in the 
cache memory units 14 In the disk array control units 
1-1-1 and 1-1-2. The search is based on Information 
stored In the shared memory units 13 Indicative of the 
directory of data of the cache memory units 14. 
[0060] In onecase of finding the requested data In the 
cache memory unit 14 of the disk array control unit 
1-1-1, the data is transferred to the channel IF unit 11 
via the CM-SW 111 wititin tiie unit 1-1-1, and then it is 
sent to ttie host computer 50. In other case of finding 
the data In the cache memory unit 14 of the disk array 
control unit 1 -1 -2, the data is transferred to the channel 
IFunitll by wayoftheCM-SWm within the unit 1-1 -2, 
the inter-unit CM-SW 1 22 and the self CM-SW 1 11 , and 
then it is sent to the host computer 50. 
[0081 ] In case the request data does not exist in any 
cache memory unit 14, the microprocessor 101 issues 
a command to another microprocessor 101 in the disk 
IF units 12 which is connected with the hard disk drive 
5 where the requested data is stored, thereby operating 
it to read out and store the data from the hard disk drive 
5 Into one cache memory unit 1 4. On receiving the conv 
mand, the microprocessor 101 in the disk IF unit 12 
reads tiie requested data out of the hard disk drive 5 
and stores the data in the cache memory unit 14 of the 
disk array control unit 1-1-1 or 1-1-2. 
[0062] In one case of storing the data in the cache 
memory unit 1 4 in the disk array control unit 1 -1 -2 which 
is connected to the hard disk drive 5 where the request- 



ed data is stored, the data is transferred to the cache 
memory unit 14 via the CM-SW 111 in the disk array 
control unit 1 -1 -2. In another case of storing the request- 
ed data in the cache memory unit 14 in another disk ar- 

5 ray control unit 1 -1 -1 whtoh is different from the disk ar- 
ray control unit 1 -1 -2 connected witti the hard disk drives 
5 in whk:h the requested data Is stored, the data is trans- 
ferred by way of the CM-SWs 111 of both units 1-1-2 
and 1-1-1 and tiie inter-unit CM-SW 122. 

10 [0063] After the requested data has been stored in the 
cache memory unit 14, the microprocessor 101 In the 
disklFunit12 indicates the cache memory unit 1 4 where 
the data has been stored to the command-issuing mi- 
croprocessor 101 in the channel IF unit 11 . In response 

IS to this indication, the microprocessor 1 01 in ttie channel 
IF unit 1 1 read the data out of the cache memory unit 14 
where the data has t>een stored and sends it to the host 
computer 50. 

[0064] According to this emt>odiment, a host compu- 
20 ter 50 can transact data with a hard disk drive 5 by simply 
issuing an access request to the disk array control unit 
1-1 to whbh it is connected without being concerned 
with as to whteh hard disk drive 5 of which disk array 
control unit 1 -1 is stored the data in need. Namely, the 
25 host computer 50 can deal with the multiple disk array 
control units 1 -1 virtually as a single disk array controller 
1. 

[0065] Furthermore, in the case of reading out data 
from a hard disk drive 5 connected to a disk array control 

30 unit 1-1 whbh is different from the unit 1-1 that has re- 
ceived the request, the data can be read out by way of 
the internal interconnection and cache memory unit 14, 
Instead of moving the data through the channel IF units 
11 of both disk array control units 1-1, whereby the de- 

35 terioration of data read/Write perfonmance can be alle- 
viated. 

[Emt)odiment 2] 

40 [0066] Rg. 5, FHg. 9 and Rg. 1 0 show another emtxxi- 
iment of this Invention. 

[0067] In Rg. 5, a disk array controller 1 whteh Is made 
up of multiple disk array control units 1-2 is ananged 
identically to the preceding Embodiment 1 shown in Fig. 

45 1 except for the connection between the channel IF units 
1 1 and disk IF units 1 2 and the shared memory units 1 3. 
In each disk array control unit 1-2, the channel IF units 
1 1 and disk IF units 1 2 and the shared memory units 1 3 
are connected directly. The shared memory units 1 3 are 

so interconnected via an interconnection 24 k)etween the 
disk array control units 1-2. Connecting the channel IF 
units 11 and disk IF units 12 and the shared memory 
units 13 directiy in each disk array control unit 1-2 re- 
duces the access time to the shared memory units 13 

ss as comparad with the connection via ttie interconnection 
21 0 whk^ is the case of Embodiment 1 . 
[0068] Rg. 9 shows a specific intemal arrangement of 
the disk array control unit 1 -2. The intemal anwgement 
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of the disk array control unit 1-2 is identical to the pre- 
ceding Embodiment 1 shown in Fig. 7 except for the con- 
nection between the channel IF units 1 1 and disk IFunits 

12 and the shared memory units 13. 

[0069] The disk array control unit 1-2 includes two 
channel IF units 11 for interfacing with computers 50, 
two disk IF units 12 for interfacing with hard disk drives 
5, two cache memory path switches (CM-SWs) 111, two 
shared memory units 13, two cache memory units 14, 
shared memory (SM) access paths 139, a cache mem- 
ory (CM) access paths 1 37 and 1 38, inter-unlt SM paths 
143, and inter-unit CM paths 142. 
[0070] The SM access controller 1 04 is connected to 
two SM controlters 1 07 whk:h is different from each oth- 
er by two SM access paths 139. Accordingly, the SM 
controller 107 has the connection of four SM access 
paths 139 coming from the two channel IF units 11 and 
two disk IF units 12. The SM controller 1 07 also has the 
connection of two inter-unit SM paths 143 for the con- 
nection with SM controllerB 1 07 of other disk array con- 
trol unit 1-2. 

[0071] Based on the above-mentioned access path 
connection of the SM controller 107, it has a function of 
directing access requests from the channel IF units 11 
and disk IF units 12 over the four access paths to the 
access paths of the memory modules 109 and the two 
Inter-unit access paths 143 of the shared memory units 

13 in other disk anBy control unit 1-2. 

[0072] Fig. 10 shows an example of the disk array 
controller 1 whk^h is configured by connecting two disk 
array control units 1 -2 shown In Fig. 9. TTie two disk ar- 
ray control units 1-2 have their shared memory units 13 
Interconnected by Inter-unlt SM paths 143 via inter-unlt 
SM-SWs 1 21 . The SM controllers 1 07 work for the con- 
nection nodes of the channel IF units and disk IF units 
and the shared memory units. The remaining portion is 
Identical to the arrangement of Emkx>diment 1 shown In 
Rg. 8. 

[0073] In case the disk array controller is made up of 
two disk array control units 1 -2, these units can be con- 
nected directly through the inter-unit paths instead of us- 
ing the inter-unlt SWs 1 21 and 1 22 without Imposing any 
problem on this Invention, while eliminating the over- 
head process of data transfer in the inter-unit SWs 121 
and 122 to Improve the perfonnance, as In the case of 
Embodiment 1 . 

[0074] The disk anray controller 1 shown In Rg. 1 0 will 
be able to include three or more disk array control units 
1 -2 by designing the inter-unit SWs 121 and 1 ^ to have 
an increased number of path connection, as in the pre- 
ceding Embodiment 1 . The number of the path, which 
can be mounted to the inter-unit SWs 121 and 122, is 
physically limited. For connecting disk array control 
units 1 -2 in excess of the limit in the numk>er of path con- 
nection of the Inter-unit SWs 121 and 122, they cannot 
be connected by one inter-unit SW. In the case, the Inter- 
unlts SWs are used In multiple stages. These inter-unlt 
SWs are built in a switch box, as in the preceding Em- 



bodiment 1 . 

[0075] Three or more disk array control units 1 -2 can 
be chained in aloopfashbn similarto the preceding Em- 
bodiment 1 shown in Fig. 13. The plural disk array con- 
5 trol units 1-2 can be connected without using the Inter- 
unit SWs 121 and 122. 

[0076] The operation of the functional units in the disk 
array control unit 1-2 for writing or reading out data to/ 
from the hard disk drives 5 by the host computers 50 Is 
10 Identical to the preceding Embodiment 1 except that the 
access to the shared memory unit 1 3 In other disk array 
control unit 1 -2 takes place via the shared memory unit 

13 In the self unit 1 -2 and the Interconnection 24. 
[0077] The inter-unit SM paths 143, inter-unit SM- 

f 5 SWs 121 , and SM controller 1 07 In unison constitute the 
interconnection 24. 

[0078] According to this emt>odiment, a host compu- 
ter 50 can transact data with a hard disk drive 5 by simply 
Issuing an access request to the disk array control unit 
20 1-2 to whch it is connected without being concemed 
with as to which hard disk drive 5 of which disk array 
control unit 1-2 is stored the data in need. Namely, the 
host computer 50 can deal with the multiple disk array 
control units 1 -2 virtually as a single disk array controller 

25 1. 

(0079] Furthermore, In the case of reading out data 
from a hard disk drive 5 connected to a disk array control 
unit 1-2 whk:h is different from the unit 1-2 that has re- 
ceived the request, the data can be read out by way of 
30 the internal interconnection and cache memory unit 1 4, 
instead of moving the data through the channel IF units 
11 of both disk array control units 1-2, whereby the de- 
terioration of data readAwrite performance can be alle- 
viated. 

35 

[Embodiment 3] 

[0080] Fig. 6, Fig. 11 and Fig. 12 show another em- 
bodiment of this Invention. 

40 [0081] In Fig. 6, a disk array controller 1 whk:h is made 
up of multiple disk an^y control units 1-3 is anranged 
klentically to the preceding Ennbbdiment 2 shown in F^. 
5 except for the connectio n between the chan nel I F units 
1 1 and disk IF units 1 2 and the cache memory units 1 4. 

^ In each disk an^y control unit 1-3, the channel IF units 
11 and disk IF units 12 and the cache memory units 14 
are connected by an Interconnection 22. The cache 
memory units 14 am interconnected t>etween disk an-ay 
control units 1-3 by an interconnection 25. The channel 

50 IF units 1 1 and disk IF units 12 and the shared memory 
units 1 3 are connected directly, whereas the channel 1 F 
units 1 1 and disk 1 F units 1 2 and the cache memory units 

14 are connected by the interconnection 22, as In the 
case of the preceding Embodiment 2, by the following 

55 reason. The shared memory unit 13 deals with control 
data having a size of several bytes for example, where- 
as the cache memory unit 14 deals with data having a 
size of several kilobytes for example. Therefore, It is In- 
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tended to raise the throughput based on the conne^on 
through the interconnec^on 22 with a linnited number of 
pins. 

[0082] By the separate provision of the interconnec- 
tion 22 which connects the channel IF units 11 and disk 
IF units 12 and the cache memory units 14 and the in- 
terconnection 25 which connect the cache memory 
units 14 between the disk array control units 1-3, data 
transfer between cache memory units 14 of different 
disk array control units 1-3 does not preclude the host 
computers 50 from making access to the cache menrtory 
units 14. 

[0083] The disk IF unit impl^ents the data transfer 
t)etween cache memories. The function of data transfer 
between cache mennory units 14 of different disk array 
control units 1-3 is necessary for moving data to a disk 
array control unit of less^requent access in dealing with 
concentrated accesses from host computers 50 to one 
disk anBy control unit 1-3. 

[0084] Fig. 11 shows a specific internal arrangement 
of the disk array control unit 1-3. The Intemal arrange- 
ment of the disk array control unit 1 -3 is identk»l to the 
preceding Embodiment 2 shown in Fig. 9 except for the 
connection between the channel IF units 11 and disk IF 
units 12 and the cache memory units 14. The CM con- 
trollers 108 work for the connection nodes of the channel 
IF units, disk IF units and cache memory units. 
[0085] The disk array control unit 1-3 includes two 
channel IF units 11 for interfacing with host computers 
50, two disk IF unitB 12 for interfacing with hard disk 
drives 5, two cache memory path switches (CM-SWs) 
111, two shared memory units 13, two cache memory 
units 14, shared memory (SM) access paths 139, cache 
memory (CM) access paths 137 and 138, inter-unit SM 
paths 143, and inter-unit CM paths 144. 
[0086] The CM access controller 1 05 is connected to 
two CM-SWs 111 by two CM access paths 137, and the 
CM-SW 111 is connected to two CM controllers 108 by 
two access paths 138. Accordingly, the CM controller 
108 has the connection of two access paths 138coming 
from the two CM-SWs 111 , and it also has the connec- 
tbn of two inter-unit CM paths 144 for the connection 
with CM controllers 108 of other disk array control unit 
1-3. 

[0087] Based on the abovennentioned access path 
connection of the CM controller 108, it has a function of 
directing access requests from the CM-SWs 111 over 
the two CM access paths 138 to the access paths of the 
memory modules 1 09 and the two inter-unit CM access 
paths 144 of the cache memory units 14 in other disk 
array control unit 1-3. 

[0088] TheCM-SWIIIhastheconnectionoffourCM 
access paths 137 coming from the two channel IF units 
1 1 and two disk IF units 1 2. and also has the connection 
of two access paths 1 38 going to the two cache memory 
units 14. 

[0089] Based on this access path connection of the 
CM-SW 111, it has a function of directing access re- 



quests from the channel IF units 1 1 and disk IF units 12 
over the four CM access paths 1 37 to the two CM access 
paths 138 of the cache memory units 14. 
[0090] Rg. 12 shows an example of the disk an^ 

5 controller 1 which is configured by connecting two disk 
array control units 1-3 shown in Rg. 11. The two disk 
array control units 1-3 have their cache memory units 
14 interconnected by inter-unit CM paths 144 via inter- 
unit CM-SWs 122. The remaining portion is identical to 

fo the arrangement of Emt)odiment 2 shown in Rg. 1 0. 
[0091 ] in case the disk array controller is nrmde up of 
two disk array control units 1-3, these units can be con- 
nected directly through the inter-unit paths instead of us- 
ing the inter-unit SWs 1 2 1 and 1 22 without imposing any 

15 problem on this invention, while eliminating the over- 
head process of data transfer in the inter-unit SWs 121 
and 122 to improve the performance, as in the case of 
Embodiment 2. 

[0092] The disk anBy controller 1 shown in Rg. 1 2 will 

so be able to include three or more disk array control units 
1 -3 by designing the inter-unit SWs to have an increased 
number of path connection, as in the preceding Emt>od- 
iment 2. The number of the path, whteh can be mounted 
to the inter-unit SWs 121 and 122, is physically limited. 

25 For connecting disk array control units 1 -3 in excess of 
the limit in the number of path connection of the inter- 
unit SWs 1 21 and 1 22, they cannot be connected by one 
inter-unit SW. In the case, the inter-units SWs are used 
In multiple stages. 

30 [0093] Three or more disk array control units 1 -3 can 
bechalned inaioopfashtonsimilarto the preceding Em- 
bodiment 1 shown in Fig. 13. The plural disk array con- 
trol units 1-3 can be connected without using the Inter- 
unit SWs 121 and 122. 

35 [0094] The operation of the functional units in the disk 
array control unit 1 -3 for transacting data with the hard 
disk drives 5 by the host computers 50 is kientical to the 
preceding Embodiment 2 except that the access to the 
cache memory unit 1 4 in other disk array control unit 1 -3 

40 takes place via the cache memory unit 14 in the self unit 

I -3 and the Interconnection 25. 

[0095] According to this embodiment, a host compu- 
ter 50 can transact data with a hard disk drive 5 by simply 
issuing an access request to the disk array control unit 

45 1-3 to whk:h it is connected without being concerned 
with as to whk:h hand disk drive 5 of which disk an-ay 
control unit 1^ is stored the data In need. Namely, the 
host computer 50 can deal with the multiple disk array 
control units 1 -3 virtually as a single disk array controller 

50 1. 

[0096] Furthemfiore, In the case of reading out data 
from a hard disk drive 5 connected to a disk array control 
unit 1-3 whk:h is different from the unit 1-3 that has re- 
ceived the request, the data can be read out by way of 
55 the Intemal interconnection and cache memory unit 1 4, 
instead of moving the data through the channel IF units 

II of both disk array control units 1-3, whereby the de- 
terioration of data read/Write performance can be alle- 
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viated. 

[0097] Next, examples of the usage of the embodt- 
ments of this invention will be explained. 
[0098] High-end disk array controllers have the fol- 
lowing function. In the function, a data set (con^spond- 5 
ing to a logical volume) for one work is duplicated and 
stored, and both the original and duplicate data sets are 
updated simultaneously in the ordinary work. At the 
emergence of the need of backup for the data set for 
example, updating of the duplicate data set Is suspend- io 
ed and it is used for the k)ackup, while the original data 
set is used continuously for the wortc, and the original 
and duplicate data sets are rendered the matching proc- 
ess on completion of backup. 

[0099] In a disk array controller 1 , which have been is 
explained as Embodiment 1 , a method of accomplishing 
this function for storing a dupibate data set in the differ- 
ent disk array control units 1 -1 will be explained with ref- 
erence to Rg. 8. It is assumed that an original data set 
Is stored on the hard disk drive 5 connected to the disk 20 
array control unit 1-1-1 and a duplteate data set Is stored 
on the hard disk drive 5 connected to the disk array con- 
trol unit 1-1-2 in Rg. 8. It also assumed that the host 
computer 50 connected to the disk array control unit 
1-1-1 woricsfortheordlnary workandthe hostcomputer 25 
50 connected to the disk array control unit 1-1-2 works 
to backup data on a tape storage unit (not shown) con- 
nected to it. 

[0100] In the ordinary work, in the event of a request 
of the host computer 50, whk^h is connected to the disk so 
array control unit 1 -1 -1 , to write data to an intended data 
set, the microprocessor 101 In the channel IF unit 11, 
whteh is connected to the host computer 50 connected 
to the disk array control unit 1 -1 -1 , transfera and writes 
the data which is sent from the host computer 50 Into S5 
the cache memory unit 14 of the disk anBy control unit 
1-1-1. Subsequently, the microprocessor 101 Issues a 
command by way of the shared memory unit 13 of the 
disk an^y control unit 1-1-1 to the mk:roprocessor 1 01 
in the disk I F unit 1 2 which is connected to the hard disk 40 
drive 5 where the original data set is stored, thereby op- 
erating on it to read, out data from the cache memory 
unit 1 4 of the disk array control unit 1 -1 -1 , transfers the 
data to the disk I F unit 1 2 whbh is connected to the hard 
disk drive 5 where the original data set is stored, and ^ 
operates on the disk IF unit 12 to transfer and write the 
data onto the hard disk drive 5. 
[0101] The microprocessor 101 in the channel IF unit 
11 of the disk an^y control unit 1-1-1, which monitors 
the updating of data of the original data set, stores in so 
the shared memory units 13 of the disk array control unit 
1 -1 -1 the control infomnation indicative of the quantity of 
updated data of the original data set. When the quantity 
of updated data exceeds a predetermined value, the mi- 
croprocessor 1 01 issues a command to the microproc- ss 
essor 101 in the disk IF unit 12 which is connected with 
the hard disk drive 5 where the ordinal data set is stored, 
thereby operating on rt to revise the duplicate data set 



to match with the updated content of the original data 

set 

[0102] The command receiving microprocessor 101 
reads out the updated data from the hard disk drive 5 
and converts the addresses of updated data into ad- 
dresses of the duplicate data set. It transfers and writes 
the updated data via the CM-SW 111 of the disk array 
control unit 1-1-1, inter-unit CM-SW 122 and CM-SW 
111 of the disk anBy control unit 1-1-2 Into the cache 
memory unit 1 4 of the disk array control unit 1 -1 -2. 
[01O3] Sut>sequently, the microprocessor 101 reads 
out the updated data from the cache memory unit 14, 
transfers the data to the disk I F unit 1 2 which is connect- 
ed to the hard disk drive 5 where the duplcate data set 
is stored, and the data Is transferred and stored onto the 
hard disk drive 5. 

[Ql 04] Based on the foregoing operation, the disk ar- 
ray controller maintains the original data set and dupli- 
cate data set during the ordinary woric. 
[QIOS] In the event of a request of the host computer 
50, whfeh is connected to the disk array control unit 
1-1-2, to backup data for an intended data set, the mi- 
croprocessor 101 in the channel IF unit 11 connected to 
the host computer 50 issues a command by way of the 
shared memory unit 13 of the disk array control unit 
1-1-1 to the microprocessor 101 in the channel IF unit 
11 which Is connected to the host computer 50 having 
the ordinary work, thereby operating on it to halt the up- 
dating of the duplicate data set. The comnnand receiving 
mteroprocessor 1 01 hafts the updating of duplicate data 
set The mteroprocessor 101 In the channel IF unit 11 , - 
which is connected to the backup requesting host com- 
puter 50, issue a command by way of the shared mem- 
ory unit 1 3 of the disk array control unit 1 -1 -2 to the mi- 
croprocessor 101 In the disk IF unit 1 2 which Is connect- 
ed to the hard disk drive 5 where the duplicate data set 
is stored, thereby operating on it to read out and transfer 
the duplcate data set from the hard disk drive 5 to the • 
disk IF unit 12, from which it is transferred and written ' 
into the cache memory unit 14 of the disk amy control 
unit 1-1-2. 

[0106] Subsequently, the mk^roprocessor 101 in the 
channel IF unit 1 1 reads out the duplicate data set from 
the cache memory unit 14 of the disk array control unit 
1-1-2 and transfers it to the channel IF unit 11, from 
which it is sent to the backup requesting host computer 
50. 

[0107] On completion of backup of data set, the mi- 
croprocessor 1 01 In the channel IF unit 1 1 , which is con- 
nected to the backup requesting host computer 50, Is- 
sues a command to the microprocessor 1 01 in the chan- 
nel IF unit 11 which is connected to the host computer 
50 having the ordinary woric through the shared memory ' 
units 13 of the disk array control unit 1-1-1, therel>y op- 
erating on it to revise the duplicate data set to match * 
with the content of the original data set whtoh has been 
updated during the backup process. This operation is 
klentical to the data updating in the ordinary woric ex- 
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plained previously. 

[0108] In accomplishing the abovennentioned func- 
tion, this operational scheme enables the movement of 
data between the two disk anay control units 1-1-1 and 

I -1 -2 via the Internal interconnections and cache menv 5 
ory units 1 4, eliminating the need of data transfer via the 
channel IF units of both disk array control units 1-1-1 
and 1-1-2. whereby the deterioration of system perform- 
ance during the innplementation of this function is alle- 
viated and thus the deterioration of efficiency of the us- io 
er's ordinary work is prevented. 

[0109] This operational scheme can be carried out 
equally in the disk an^y controller 1 of Embodiment 2 
and Embodiment 3 without problems, and the same ef- 
fectiveness is attained. is 
[01 1 0] Other usages include the following. 
[0111] in the disk anBy controllers 1 of Embodiment 
1 , Embodiment 2 and Embodiment 3, when a host com- 
puter 50 sends a data read request, for example, to a 
disk array control unit and if the data is absent on the 20 
hard disk drive 5 connected to the unit, it is necessary 
to read out the data via an Interconnection from another 
disk anBy control unit connected with a hard disk drive 
5 where the data is stored and send the data to the re- 
questing host computer 50. The data readAvrite opera- 23 
tion across the border of disk anay control units, as in 
this case, results in the deterioration of perfonnance as 
compared with the operation within a unit. 
[0112] For avoiding the data transfer between units, 
it is necessary for the system to have a function of mov- 30 
Ing data, which is accessed frequently by one host com- 
puter 50 and is stored on a hard disk drive connected to 
a disk array control unit other than the control unit con- 
nected to the one host computer 50, to the hard disk 
drive 5 of the control unit connected to the one host com- 35 
puter 50. 

[01 13] This data moving function implemented by the 
disk array controller 1 of Embodiment 1 will be explained 
with reference to Fig. 8. 

[0114] The microprocessor 101 in the channel IF unit ^ 

II monitors the frequency of access to data sets (cor- 
responding to logk»l volumes) on all hard disk drives 5, 
and stores control information indk:atlve of the access 
frequency of the data sets in the shared memory units 

1 3 within the same disk an^y control unit 1 -1 -1 . ^ 
[01 1 5] If the host computer 50 connected to the disk 
array control unit 1 -1 -1 makes access to the data set on 
the hard disk drive 5 connected to another disk array 
control unit 1 -1 -2 to concentrate the access on the data 
set, the access frequency is exceed a predetermined so 
rate, the microprocessor 101 in the channel IF unit 11 
of the disk array control unit 1-1-1 Issues a command 
through the shared memory unit 13 in the other disk ar- 
ray control unit 1-1-2 to the mk:roprocessor 101 in the 
disk IF unit 12 whk:h is connected with the hard disk ss 
drive 5 where the data set is stored, thereby operating 
on It to read out the data set and transfer and write the 
data set into the cache memory unit 1 4 of the disk array 



control unit 1-1-2. 

[0116] Subsequently, the microprocessor 101 in the 
channel IF unit 11 of the disk array control unit 1-1-1 
reads out and transfers the relevant data from the cache 
memory unit 1 4 of the disk array control unit 1 -1 -2 to the 
cache memory unit 14 of the disk array control unit 
1-1-1. The microprocessor 101 subsequently issues a 
connmand by way of the shared memory unit 13 in the 
disk an^y control unit 1-1-1 to the microprocessor 101 
in the disk IF unit 12 of the disk array control unit 1-1 -1 , 
thereby operating on It to read out, transfer and write the 
relevant data from the cache memory unit 14 of the disk 
array control unit 1-1-1 onto the hard disk drive 5. 
[0117] This operational scheme enables the move- 
ment of data between two disk array control units 1-1 
via the internal interconnectk>ns and cache nnemory 
units 14, eliminating the need of data transfer via the 
channel 1 F units of both disk array control units, wheret^y 
the detertoration of system performance during the data 
movement is alleviated and thus the detertoration of ef- 
ficiency of the user's ordinary woric is prevented. 
[0118] This operational scheme can be carried out 
equally in the disk an^y controller 1 of Embodiment 2 
and Embodiment 3 without problems, and the same ef- 
fectiveness is attained. . 
[01 1 9] Next, the structure of the disk array controllers 
of Embodiment 1 , Ennbodiment2 and Embodinnent3 will 
be explained. 

[0120] Rg. 14 shows an example of the structure of 
the disk array control unit 1-1 of Embodiment 1 shown 
in Fig. 7 built on a rack 201 . The channel IF units 11 are 
arranged in channel IF packages (PKs) 311 , the disk IF 
units 12 are arranged In disk IF packages 312, the SM- 
SWs 110 and CM-SWs 1 1 1 are ananged in switch pack- 
ages 320, and the shared memoiy units 13 and cache 
memory units 14 are arranged in memory packages 
330. These packages are plugged Into the sockets on 
a back board 340, which has the wiring of the SM access 
paths 135 and 136 and the CM access paths 137 and 
138. 

[0121] The switch packages 320 has the connection 
of cables of the Inter-unit SM paths 141 and cables of 
the Inter-unit CM paths 142, and these cables have oth- 
er ends connected to connectors 221 and 222, respec- 
tively, on the side wall of the rack 201 . The cables are 
not shown. A power unit 350 supplies electric power to 
the packages. The disk array control unit built on a rack 
as shown operates as a stand-alone disk array control- 
ler. 

[01 22] Rg. 1 5 shows an example of the Interconnec- 
tion of two sets of the disk array control unit built on the 
rack 201 shown in Rg. 14. 

[0123] A switch box 210 houses the inter-unlt SM- 
SWs 121 and inter-unit CM-SWs 122 shown in Rg. 8. 
The inter-unit SM paths 141 coming from the inter-unit 
SM-SWs 1 21 are connected to connectora 221 , and the 
Inter-unlt CM paths 142 coming from the Inter-untt CM- 
SWs 122 are connected to connectora 222. 
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[0124] For interconnecting the two disk anBy control 
units on the racks 201 and 202, the inter-unit SM path 
connectors 221 on the rack 201 are connected to the 
connectors 221 on the switch box 21 0 with cables 231 , 
and the inter-unit CM path connectors 222 on the rack 
201 are connected to the connectors 222 on the switch 
box 210 with cables 232. Similarty, the connectors 221 
on the rack 202 are connected to the connectors 221 on 
the switch box 210 with cables 231 , and the inter-unit 
CM path connectors 222 on the rack 202 are connected 
to the connectors 222 on the switch box 21 0 with cables 
232. 

[0125] The disk array controller built on two racks In 
this manner can deal with an increased number of host 
computerchannels and an increased storage capability. 
[0126] By designating the racks 201 and 202 to be a 
basic and extension racks, respectively, and accommo- 
dating the switch box 21 0 inside the extension rack 202, 
It becomes possible to eliminate the floor space for the 
switch box 210 without increasing the manufacturing 
cost of the basic rack 201. 

[01 27] This structural scheme can also be applied to 
the disk array controllers of Embodiment 2 and Embod- 
iment 3 without any problem. 
[01 28] Fig. 1 8 shows the interconnec^on of three disk 
array control units by inter-unit SM-SWs 121 and CM- 
SWs 122. Each switch (SW) which connects three disk 
array control units must have a larger capability as com- 
pared with the case of connecting two units. Specifically, 
disk an^y control units 1-1-1,1-1 -2 and 1 -1 -3 are inter- 
connected through inter-unit SM paths 141 and inter- 
unit CM paths 142 via the inter-unit SM-SWs 121 and 
CM-SWs 122. and function as a disk an^ay controller. 
[0129] Fig. 19 shows the structure of this disk array 
controller. The switch box 21 0 has a separate rack. The 
disk array control units built on indivklual racks 201 ,202 
and 203 are interconnected by Inter-unit SM path cables 

231 and connectors 221 and inter-unit CM path cables 

232 and connectors 222. Providing more capability and 
more connectors for the switch box 21 0 for connecting 
four or more disk array control units fadiitates the addi- 
tional installation in the future. 

[01 30] Fig. 21 shows the format of data whk:h is trans- 
ferred through the switch box 210. Data has a fomri of 
packet, and it consists of a destination address field 401 , 
command field 402 and data field 403. The address is 
of the shared memory and cache memory. 
[0131] Fig. 22 shows a reference table 410 for path 
switching provided in the switch box 21 0. This table con- 
tains the correspondence between the destination ad- 
dress and the port number of the disk anray control unit. 
The switch box 21 0 makes reference to the path switch- 
ing table to determine a destination unit based on the 
address 401 in the packet data 400 and implements the 
path switching. 

[0132] Additional installation of disk array control 
units is carried out based on the folbwing procedure. If 
the switch box 210 has spare connectors for additional 



disk anay control units, cables 231 and 232 are con- 
nected to these connectors. If there are no spare con- 
nectors, another switch box is added in a multi-stage 
configuration and cables 231 and 232 are connected to 

5 it. The path switching table 41 0 In the switch box 21 0 Is 
revised to include the addresses and port numk>ers for 
the additional disk array control units. An aitemative de- 
sign of the table is to preset additional addresses with 
flags so that address flags are turned on for the addi- 

10 tionai unit installation. 

[0133] Rg. 20 shows another unit interconnectton 
scheme. In a disk array controller, three disk array con- 
trol units are interconnected in series. SM-SWs 1 1 0 and 
CM-SWs 111 have a bridge function of transfening in- 

'5 coming data intact to other disk array control unit. These 
SM-SWs 110 and CM-SWs 111 may be replaced with 
common buses, by whteh multiple disk array control 
units are interconnected. 

[01 34] Further the other embodiment will be shown as 
so follows. 

[0135] As shown in Rg. 16, a disk array control unit 
made up of a minimal number of packages (PKs), whk:h 
are used In the unit rack 201 shown in Rg. 14, is built 
on a rack 205. 

25 [0136] As shown in Rg. 17, two or more unit racks 205 
and a switch box 21 0 are built on a large rack 206, and 
the units on the racks 205 are Interconnected via the 
switch box 21 0 based on the interconnection scheme of 
the sixth embodiment This structure is suitable for mid- 

30 die-scale to large-scale disk array controllers. The rack 
205 has the same role for the disk array control unit as 
of the foregoing one, or attematively the disk array con- 
trol unit may have a module stmcture. Each disk array 
control unit on the rack 208 may include an individual 

35 power unit, or all units may t>e supplied with powerf rom 
a single power unit. 

[0137] According to the present Invention, it becomes 
possible to construct a disk array system which is based 
on the operation of multiple disk array control units as a 
^ single disk array controller and is capable of alleviating 
the deterioration of perfomnance caused by the move- 
ment of data between the disk array control units. 



45 Claims 

1 . A disk array controller (1 ) comprising: 

a plurality of disk array control units (1-1, 1-2, 
so 1 each having one or more channel inter- 

face units (11) for interfacing with a host com- 
puter (50); one or more disk interface units (1 2) 
for interfacing with disk drives (5); a cache 
memory unit (14) for temporarily storing data 
55 which is written to or read out of said disk drives 

(5); and a shared memory unit (13) for storing 
control Infonnation of data transfer between 
said channel interface unit (11) and disk inter- 
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face unit (1 2) and said cache memory unit (14) 
and control information for said disic drives (5), 
said disk array control unit (1-1,1-2,1 -3) imple- 
menting the data read/write operation in re- 
sponse to a data read/Write request from said 
host computer (50) by operating on said chan- 
nel interface unit (11) to transfer data between 
said interface (11) with said host computer (50) 
and said cache memory unit (14) and operating 
on said disk Interface unit (1 2) to transfer data 
between said disk drive (5) and said cache 
memory unit (14), 

said channel interface units (11) and disk inter- 
face units (12) and said cache memory units 
(14) in said disk array control units (1-1, 1-2, 
1-3) having their connection nodes Intercon- 
nected through a first Interconnection (25. 220) 
across the border of disk array control units 
(1-1.1-2,1-3), 

said channel interface units (11) and disk Inter- 
face units (12) and said shared memory units 
(13) in said disk array control units (1-1, 1-2, 
1-3) having their connectton nodes intercon- 
nected through a second interconnection (24, 
210) across the border of disk array control 
units. 

2. A disk array controller according to claim 1 , wherein 
said channel interface units (11) and disk interface 
units (12) and said cache memory units (14) in said 
multiple disk array control units (1-1, 1-2, 1-3) are 
connected through said first Interconnection (220), 
and said channel interface units (11) and disk inter- 
face units (12) and said shared memory units (13) 
are connected through said second Interconnection 
(210). 

3. A disk array controller according to claim 1 , wherein 
said channel interface units (11) and disk interface 
units (12) and said cache memory units (14) in said 
multiple disk array control units (1-1, 1-2, 1-3) are 
connected k>y said first Interconnection (220), and 
said channel interface units (11) and disk interface 
units (12) and said shared memory units (13) are 
connected directly for the portion within each disk 
array control unit. 

4. A disk array controller according to claim 1 , wherein 
said channel interface units (11) and disk interface 
units (12) and sakj cache memory units (14) in said 
multiple disk array control units (1-1, 1-2, 1-3) are 
connected for the portion within each disk array 
control unit through a third Interconnection in each 
disk array control unit, and said channel interface 
units (11) and disk interface units (12) and said 
shared memory units (1 3) are connected directly for 
the portion within each disk array control unft. 



5. A disk anray control unit comprising: 

one or more channel Interface units (11) for in- 
terfacing with a host computer (50); one or 
5 more disk interface units (12) for Interfacing 

with disk drh^es (5); a cache memory unit (14) 
for temporarily storing data which Is written to 
or read out of said disk drives (5); and a shared 
memory unit (13) for Coring control infonnatlon 
10 of data transfer t>etween said channel interface 

unit (11) and disk interface unit (12) and said 
cache memory unit (1 4) and control information 
for said disk drives (5), 

said disk array control unit implementing the 
IS data read/Write operation in response to a data 

read/write request from saki host computer (50) 
by operating on said channel Interface unit (1 1 ) 
to transfer data between said interface with said 
host computer (50) and said cache memory unit 
20 (14) and operating on sakj disk interface unit 

(1 2) to transfer data between said disk drive (5) 
and said cache menrwry unit (14), 

said disk anBy control unit having, on the con- 
nection node of said channel interface unit (11) 
25 and disk interface unit (12) and said cache 

mennory unit (14), a first connection path (25, 
220) for the connection with other disk anay 
control unit, and having, on the connection 
node of said channel interface unit (11) and disk 
30 interface unit (1 2) and said shared memory unit 

(1 3) , a second connectton path (24, 21 0) for the 
connection with the other disk array control 
unit. 

35 6. A disk array control unit according to claim 5, where- 
in said disk array control unit is built on a rack (205), 
and said first and second connection paths have 
connectore (221 , 222). . 



40 7. A disk array controller comprising: 

a plurality of disk array control units (1-1 , 1-2, 
1-3), each having one or more channel Inter- 
face units (11) for interfacing with a host com- 

45 puter (50); one or more disk interface units (1 2) 

for interfacing with disk drives (5); a cache 
memory unit (14) for temporarily storing data 
whbh is written to or read out of said disk drives 
(5); and a shared memory unit (13) for storing 

50 control infomiation of data transfer between 

said channel interface unit (11) and disk inter- 
face unit (12) and said cache memory unit (14) 
and control infomiation for said disk drives (5), 
said disk array control unit implementing the 

55 data readAvrite operation in response to a data 

readAwrite request from said host computer (50) 
by operating on said channel interface unit (11) 
to transfer data between said interface with said 
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host computer (50) and said cache memory unit 
(14) and operating on said disk interface unit 
(1 2) to transfer data between said disk drive (5) 
and sakJ cache memory unit (14), 
said disk array control units (1-1,1 -2, 1 -3) hav- 5 
ing, on the connection nodes of said channel 
interface units (11) and disk interface units (12) 
and said cache m^ory units (14), a first con- 
nection path (25, 220) for the connection with 
other disk array control unit (1-1,1 -2, 1 -3), and io 
having, on the connection nodes of said chan- 
nel interface units (11) and disk interface units 
(1 2) and said shared memory units (13), a sec- 
ond connection path (24, 210) for the connec- 
tion with the other disk array control unit (1 -1 , is 
1-2,1-3); and 

a switch box (21 0) which Is connected with said 
first and second connection paths of said disk 
array control units (1 2), thereby Integrating said 
disk array control units (12) functionally into a 20 
single disk array controller. 

A method of increasing the number of disk array 
control units in a disk array controller which com- 
prises: ^ 

a plurality of disk array control units each hav- 
ing one or more channel interface units for in- 
terfacing with a host computer; one or more 
disk interface units for Interfacing with disk 30 
drives; a cache memory unit for temporarily 
storing data which is written to or read out of 
said disk drives; and a shared memory unit for 
storing control infonnatlon of data transfer be- 
tween said channel interface unit and disk In- 3S 
terface unit and said cache memory unit and 
control information for sM disk drives, and im- 
plementing the data read/write operation in re- 
sponse to a data readAvrite request from said 
host computer by operating on said channel in- 40 
terface unit to transfer data between said inter- 
face with said host computer and saM cache 
memory unit and operating on said disk inter- 
face unit to transfer data between said disk 
drive and satel cache memory unit, 45 
said disk array control units having, on the con- 
nection nodes of said channel interface units 
and disk interface units and said cache memory 
units, a first connection path for the connection 
with other disk array control unit, and having, so 
on the connection nodes of said channel inter- 
face units and disk Interface units and said 
shared memory units, a second connection 
path for the connection with the other disk array 
control unit; and a switch box which is connect- ss 
ed with said first and second connection paths 
of said disk array control units, thereby integrat- 
ing said disk array control units functionally into 



a single disk array controller, 
said first and second connection patiis and said 
switch box having connectors, 
said switch box having its connectors connect- 
ed by cables to connectors of the first and sec- 
ond connection paths of adiskanBy control unit 
to be added to said disk array controller 

9. A method of increasing disk array control units ac- 
cording to daim 8, wherein said switch box has an 
infonnation table for storing Information indtoative 
of the correspondence between the destination ad- 
dress of data which is transferred through said 
switch box and information whnh indicates a disk 
anBy control unit to be connected, said information 
table t)eing rendered the additton of correspond- 
ence infonmation for a disk array control unit to be 
added to saM disk array controller. 

10. A method of increasing disk array control units ac- 
cording to daim 8 , wherein said disk array control 
units are built on individual racks and said switch 
box is built together with a disk array control unit on 
one of said racks, said switch box having the con- 
nec^on of a plurality of cables which are connected 
to racks of other disk array control units. 

11. A disk anBy controller comprising by being built on 
a single rack: 

a plurality of disk array control units (1-1 , 1-2, 
1-3), each having one or more channel inter- 
face units (11) for interfacing with a host conrv 
puter (50), one or more disk interface units (1 2) 
for interfacing with disk drives (5), a cache 
menrK>ry unit (14) for temporarily storing data 
which is written to or read out of said disk drives 
(5). and a shared memory unit (13) for storing 
control infomiation of data transfer between 
said channel Interface unit (11) and disk inter- 
face unit (12) and said cache memory unit (14) 
and control information for said disk drives (5), 
and implementingthe data nead/write operation 
in response to a data readAvrite request from 
said host computer (50) by operating on said 
channel interface unit (11) to transfer data be- 
tween sakj interface with said host computer 
(50) and said cache menrK>ry unit (14) and op- 
erating on said disk interface unit (12) to trans- 
fer data between said disk drive (5) and said 
cache memory unit (1 4), said disk array control 
units (1-1, 1-2, 1-3) having, on the connection 
nodes of said channel interface units (11) and 
disk interface units (12) and said cache mem- 
ory units (14), a first connection path (25, 220) 
for the connedion with other disk anBy control 
unit, and having, on the connection nodes of 
said channel interface units (11) and disk inter- 
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face units (12) and said shared memory units 
(1 3). a second connection path (24, 21 0) for the 
connection with the other disk anay control 
unit; and 

a switch box (21 0) which is connected with said 5 
first and second connection paths of said disic 
array control units, theret>y Integrating said dislc 
array control unte functionally into a single disk 
array controller. 
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FIG.2 
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FIG.3 
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50->HOST C0N4PUTER 




SWARD 
DISK DRIVES 



mcHANwai 

IF UNIT 




U 12f>ISK X, 
Tl IF UNIT Ih 




SftHOST COMPUTER 




5:HARD 
DISK DRIVES 



ULCHANNELn 
IF UNIT 




12;DISK 



T 



22ftINTER CONNECTION 



13:SHARED 
MEMORY 
UNIT 



14:CACHE 
MEMORY] 
UNIT 



Xn 
• •• 




13:SHAREDi 
MEMORY 
UNIT 



3 



14CACHE 
MEMORYl 
UNIT 



24dhrTER CONNECTION 



1-2DISK ARRAY CONTROL UNTT 



1-2DISK ARRAY CONTROL UNIT 



1J5ISK ARRAY CONTROLLER 



20 



EP1 132805A2 



FIG.6 



5W0ST COMPUTER 



SiHARD 
DISK DRIVES 





SOHOST COMPUTER 




SiHARD 
DISK DRIVES 




IF UNIT 




12iDISK 

IF uNrn 



22dNTGR 
CONNEOnONv 



laSHARED 
MEMORY 

UNrr.. 



MXDACHE 
MEMORYI 

UNrr 



Xn 
• •• 



UtOIANNafU 

IF UNrr 



T 



laSHARED 
MEMORY 

UNrr 



140ACHE 
MEMORYI 

UNrr 



24JNTER CONNECTION 
1= 



C 



I 



I 



25:INTER CONNECTION 



1-3DISK ARRAY CO^fTROL UNIT 



l-aOISK ARRAY CONTROL UNH" 



1DISK ARRAY CONTROlieR 



21 



EP1 132805 A2 




EP1 132805 A2 



FIG.8 



5&H0ST COMPOTER 

SiHARD DISK DRIVES 



SOHOST COMPUTER 

5i4ARD DISK DRiVES 





121: 

SM-SW ' 
BETWEEN 
UNITS 





ll-CHANNa 

IF uNrr 



12J5ISK 
F UNIT 



13:SHARED 






14K5ACHE 


MEMORY 






MEMORY 


UNIT 






UNIT 



I-I-IDBK ARRAY CONTROL UNIT 



141: 

SMPATH 
BETWEEN 
UNITS 




142: 
CM PATH 
BETWEEN 
UNTTS 



^1.cHAN^GJ^ 

IF UNIT 



12DISK 
IF UNIT 



14:CACHE 






13:SHARED 


MEMORY 






MEMORY 


UNIT 






UNIT 



1-1-2DISK ARRAY COMTT?OL UNIT 



122: 

CM-SW 

BETWEEN 

UNITS 



1DISK ARRAY CONTROLLER 



23 



EP1 132 805 A2 




24 



EP1 132805 A2 



FIG.10 



SttHOST COMPUTER 

SmRD DISK DRIVES 



SftHOST COMPUTER 





5JHARD DISK 
DRIVES 




F UNfT 



12:DISK 
IF UNIT 



13:SHARED 






14K5ACHE 


MEMORY 






MEMORY 


UNIT 






UNIT 



1-2DISK ARRAY CONTROL UNHT 



hICHANNBJl 
IF UNIT 



142: 
CMPATTi 
BETWEENI 
UNITS 



12DISK 
IF UNfT 





140ACHE 






135HARED 


MEMORY 






MEMORY 


UNfT 






UNfT 



1-2DISK ARRAY CONTROL UNfT 



121: 

SM-SW 

BETWEEN UNITS 



143: 

Ieiy^ IDISK ARRAY COhfTROLLER 
UNfTS 



25 



EP1 132 805 A2 




26 



EP1 132 805 A2 



FIG.12 



SftHOST COMPUTER 

SiHARO DISK DRIVES 



SOtHOST COMPUTER 




5:HARD DISK 
DRIVES 




I13SHARED 
MEMORY 
UNFT 



14:CACHE 
MEMORY 
UNfT 



1-3DISK ARRAY COTfTROL UNFT 



122: 

CM-SW 
BETWEEN 
UNITS 



144: 
CM PATH 
BETWEEN 
UNITS 




14CACHE 
MEMORY 
UNIT 



h3:SHARED 
MEMORY 
UNIT 



1-3:DISK ARRAY CONTROL UNIT 



121: y 143: 

SM-SW SM PATH 

BETWEEN UNITS BETWEEN UNITS 



1:DISK ARRAY GONTFIOLLER 



27 



EP1 132805 A2 



FIG.13 



1DISK ARRAY CONTROLLER 



iLomej 

F UNIT 



U 1-1J5ISKARRAY 
COhrTROLUNIT 



12£)iSK 
IF UNIT 



13:SHARED 
MEMORY 
UNFT 



14:GACHE 
MEMORY 

UNrr 



11CHANNa_h 
F UNIT 

I 



12DISK h 
IF UNFT 

Z 




135HARED 
MEMORY 
UNfT 

I 



14CACHE 
MEMORY 
UNfT 




1-1:DISK ARRAY CONTROL UNIT 



SMPATH 
BETWEEN 
UNTFS 

142: 
CM PATH 
BETWEEN 
UNITS 



ncHAfvmri 

F UNFT 



12DISK 
F UNfT 




14CACHE 
MEMORY 
UNfT 



r 



laSHARED 
MEMORY 
UNPT 



r 



1-1i)ISK ARRAY CONTROL UNIT 



'142: 

CM PATH 
BETWEEN 
UNITS 



141: 
SMPATH 
BETWEEN UNTTS 



28 



EP1 132805 A2 



FIG.14 




29 



EP1 132805 A2 



FIG.15 




30 



EP1 132 805 A2 




31 



EP11%805 A2 




EP1 132805 A2 



FIG.18 



121: 

SM-SW 

BETWEEN UNITS 



122: 

CM-SW 

BETWEEN UNITS 




IDISK ARRAY CONTROLLER 



33 



EP1 132805 A2 



FIG.19 




222: 

CONNECTOR 




221:CONNECTOR 



34 



EP1 132 805 A2 



FIG.20 



IF UNIT 



U l-t:DISK ARRAY 



COWTROLUNIT 



12J)ISK 
IF UNfT 



13.-SHARED 
MEMORY 
UNIT 



14^5ACHE 
MEMORY 
UNIT 



>- 110 



1DISK ARRAY 
CONTROLLER 



IIjCHANNBJ 
IF UNIT 



12:DISK h 
IF UNIT 




13SHARED 
MEMORY 
UNIT 



T 



14CACHE 
MEMORY 
UNIT 



l-l-IDISK ARRAY 
CONTROL UNIT 



141: 

SMPATH 
BETWEEN 
UNITS 

142: 
CM PATH 
BETVVEEN 
UNITS 




14K5ACHE 
MEMORY 
UNIT 



laSHARED 
MEMORY 
UNIT 



1-1-lJDISK ARRAY 
CONTROL UNIT 



M42: 

CM PATH 
BETWEe^ 
UNITS 



141: 
SMPATH 
BETWEEN UNITS 



35 



EP1 1^805 A2 

FIG.21 



400:PACKET 



401: 


402: 


403: 


ADDRESS 


COMMAND 


DATA 



FIG.22 

410:REFFERENCE TABLE 
FOR PATH SWITCH 



ADDRESS. 


PORT No. 


0x0- ••000 


0 


OXO---001 


0 


• 
• 
• 


■ 
■ 
■ 


0X0- "OFF 


0 


0X0---100 


1 


• 
■ 
■ 


■ 
■ 

a 


0x0- ••200 


2 


■ 
• 
■ 


■ 
■ 
■ 



36 



